VOICE CONTROL SYSTEM 



CROSS REFERENCE TO RELATED APPLICATION 
This application is based on and incorporates herein by 
reference Japanese Patent Application No. 2002-216070 filed on 
July 25, 2002. 

FIELD OF THE INVENTION 
The present invention relates to a voice control system 
having a function for providing a proper usage of voice 
command when an improper voice command is inputted. 

BACKGROUND OF THE INVENTION 

A voice control system that recognizes a voice command 
inputted by a user and controls a target device based on the 
voice command is shown in FIG. 11. The user inputs the command 
to the system via a microphone Zl. A voice recognition circuit 
Z2 compares the inputted command with command recognition data 
stored in command list storage (dictionary) Z3, and selects a 
command that matches the inputted command. The extracted 
command is outputted to a function control circuit Z4. The 
function control circuit Z4 sends a signal to the target 
device Z5 to perform the function corresponding to the command. 
The user can operate the target device Z5 with voice commands. 

However, the system is not configured to handle a command 
that is inexecutable in the current settings of the target 
device. In a case of a vehicle navigation system using the 



voice control system^ the user has to choose a command 
depending on the current settings of the vehicle navigation 
system. For example, the user has to select either one of a 
"set" command for setting a destination for the first time or 
5 a "reset" command for canceling a set destination and setting 

a new destination. If the command that the user has chosen is 
inexecutable in the current settings, the command will be 
never executed. Since the user is not notified of the reason 
why the requested command is not executed, the user may get 

10 confused. 

This problem may be solved by removing inexecutable 
commands from dictionary in which recognizable commands are 
stored according to the current function settings. However, 
the user is still not notified of the reason. Furthermore, the 

15 navigation system may perform a function that the user does 

not expect when the user has inputted an improper command. 
Thus, the user may get confused. 



SUMMARY OF THE INVENTION 

20 The present invention therefore has an objective to 

provide a voice control system that has a function for 
providing a proper usage of command when an improper voice 
command is inputted. A voice control system of the present 
invention includes a recognizable command storing means, a 

25 voice recognition means, a message output means, a function 

setting detection means, and a command executability 
determination means. The storing means stores recognizable 
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commands as voice recognition data. The voice recognition 
means recognizes a voice command inputted by a user as one of 
the recognizable commands by matching between the voice 
command and the recognizable commands. 
5 The message output means provides proper usages of 

commands to the user, and the detection means detects a 
current condition of a target device. The determination means 
determines whether the recognized command is executable in the 
current function settings of the target device. The 

10 determination means also provides a proper usage of the 

command to the user when the command is inexecutable. 

The voice control system provides a proper usage of a 
voice command when the command is inexecutable . In other words , 
the user is notified of the reason why the command is not 

15 executed even when the user has inputted an improper command. 

The system helps the user to operate the target device by 
providing a proper usage of command and the reason why a 
requested command is not executed. Therefore, the user can 
operate the target device without confusion even when the user 

20 is not familiar to commands. 

BRIEF DESCRIPTION OF THE DRAWINGS 
The above and other objectives, features and advantages 
of the present invention will become more apparent from the 
25 following detailed description made with reference to the 

accompanying drawings. In the drawings: 

FIG. 1 is a block diagram of a voice control system 
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according to the first embodiment of the present invention; 

FIG. 2 is a flowchart showing a process for changing 
function settings of a navigation system according to a voice 
command inputted by a user according to the first embodiment; 
5 PIG. 3 is a block diagram of a voice control system 

according to the second embodiment of the present invention; 

PIG. 4 is a flowchart showing a process for changing 
function settings of a navigation system according to a voice 
command inputted by a user according to the second embodiment; 
10 PIG. 5 is a block diagram of a voice control system 

according to the third embodiment of the present invention; 

PIG. 6 is a flowchart showing a process for changing 
function settings of a navigation system according to a voice 
command inputted by a user according to the third embodiment; 
15 PIG. 7 is a block diagram of a voice control system 

according to the fourth embodiment of the present invention; 

PIG. 8 is a flowchart showing a process for changing 
function settings of a navigation system according to a voice 
command inputted by a user according to the fourth embodiment; 
2 0 PIG. 9 is a block diagram of a voice control system 

according to the fifth embodiment of the present invention; 

FIG. 10 is a flowchart showing a process for changing 
function settings of a navigation system according to a voice 
command inputted by a user according to the fifth embodiment; 
25 and 

FIG. 11 a block diagram of a voice control system 
according to a related art. 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 
The preferred embodiments of the present invention will 
be explained with reference to the accompanying drawings . In 
the drawings, the same numerals are used for the same 
5 components and devices. 

[First Embodiment] 

A voice control system 1 shown in FIG. 1 includes a 
command list storage lA, a voice recognition circuit IB, a 
function setting detection circuit IC, a function control 

10 circuit ID, a relational command list storage IE, and a 

command executability determination circuit IF. The coiranand 
list storage lA stores voice recognizable command data that is 
a dictionary of voice control commands for operation of a 
vehicle navigation system 2. 

15 The voice recognition circuit IB matches a voice command 

inputted by a user via a microphone 3 with commands in the 
dictionary. Then, it selects the command most closely matches 
the voice command from the dictionary. The detection circuit 
IC connected to the navigation system 2 detects function 

20 settings of the system 2 at regular intervals by interrupting 

the operation. An event-driven determination may be used by 
outputting a signal from the system 2 every time when any 
changes are made to the settings. 

The function control circuit ID sends signals to the 

25 system 2 for changing the function settings. The relational 

command list storage IE creates a list of commands that are 
commonly confused or commonly misrecognized with a 
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recognizable command for each recognizable command and stores 
the list. 

The determination circuit IF determines whether the 
command selected by the recognition circuit IB is executable 
in the current function settings. If the command is executable^ 
a signal is sent to the control circuit ID for sending a 
signal to the navigation system 2 to execute the command. If 
the command is inexecutable, a voice message is outputted via 
a speaker 4^ which is a message output device. The voice 
message provides an indication that the command is 
inexecutable and a proper usage of the command. The 
determination circuit IF refers to the relational command list 
stored in the storage lE^ and selects a command that is 
executable and related to the voice command. Then, it provides 
a voice message of the selected coimnand via the speaker 4. 

The voice control system 1 changes the function settings 
of the system 2 according to a voice command inputted by the 
user following a process shown in FIG. 2. A voice command is 
inputted from the user to the system 1 via the microphone 3 
(S201). The voice command is matched with the commands in the 
dictionary, and the most closely matched command is selected 
as a voice command inputted by the user (S202). 

It is determined whether the selected command is 
executable in the current function settings of the navigation 
system 2 (S203). If the command is executable, the process 
proceeds to step S204. If the command is inexecutable, the 
process proceeds to step S205. At step S204, a signal is sent 



to the navigation system 2 for executing the selected command. 
The function of the navigation system 2 requested by the user 
is performed and the process is completed. At step S205, a 
voice message is outputted via the speaker 4 for providing an 
5 indication that the voice command is inexecutable and a proper 

usage of the command. 

At step 6, an executable command related to the voice 
command is selected from the list and a voice message is 
outputted via the speaker 4 for prompting the user to use the 

10 command. In other words, the user is notified of the reason 

why the voice command is not executed and the proper usage of 
the voice command. Thus, the user can learn the proper usage 
of the command without confusion. 

The relational command list includes commands that are 

15 commonly confused or commonly misrecognized with recognizable 

commands. The system 1 helps the user to find the command that 
the user intends to use by selecting an executable command 
from the list and provides a voice message of the selected 
command. 

20 A process performed when an improper voice command is 

inputted by the user will be explained. A case of setting a 
destination is taken as an example. A command for setting a 
destination is either a "set" command or a "reset" command. 
The set command is used when setting a destination for the 

25 first time while the reset command is used when canceling a 

set destination and setting a new destination. The set command 
is stored in the relational command list of the reset command 
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and in the confirmation-required command list. 

Assuming that the user has inputted the reset command 
during setting a destination for the first time, the reset 
command is inexecutable because the destination has not been 
5 set. In this case, a voice message of a proper usage of the 

reset command is outputted via the speaker 4 . The voice 
message says something like, "The reset command is for 
canceling a set destination and setting the currently 
displayed point as a new destination," or "You can use the 

10 reset command only when a destination has been set." Then, a 

command related to the reset command is searched. The set 
command that relates to the reset command is stored in the 
relational command list. Since the set command is executable, 
a voice message saying, "Please use the set command," is 

15 outputted from the speaker 4. If more than one executable 

commands are found in the list, a voice message of all 
commands is outputted followed by another message saying, 
"Please select from those commands." 
[Second Embodiment] 

2 0 A voice control device 20 includes a substitution 

determination circuit IG instead of the command executability 
determination circuit IF as shown in FIG. 3. The circuit IG 
determines whether the command selected by the recognition 
circuit IB as a voice command of the user is executable in the 

25 current function settings detected by the circuit IC. If the 

command is executable, the circuit IG sends a signal to the 
function control circuit ID for sending a signal to the 
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navigation system 2 for executing the command. If the command 
is inexecutable, the determination circuit IG refers to a 
relational command list related to the voice command in the 
relational command list storage IE. Then, the determination 
circuit IG selects an executable command from the list as a 
substitution and executes the selected command. After the 
execution of the command, a voice message is outputted for 
providing name and usage of the command and a proper usage of 
the voice command. 

The voice control system 20 changes the function settings 
of the system 2 according to a voice command of the user as 
shown in FIG. 4. A voice command is inputted by the user via 
the microphone 3 (S401). The voice command is matched with the 
commands in the dictionary stored in the command list storage 
lA, and the most closely matched command is selected as a 
voice command of the user (S402). 

It is determined whether the command selected at step 
S402 is executable in the current function settings of the 
navigation system 2 (S403). If the command is executable, the 
process proceeds to step S404. If it is inexecutable, the 
process proceeds to step S405. At step S404, a signal for 
executing the coimnand selected at step 84 02 is sent to the 
navigation system 2. The function of the navigation system 2 
requested by the user is performed and the process is 
completed . 

At step S4 05,« an executable command related to the voice 
command is selected from the relational command list as a 



substitution, and executed. A voice message is outputted for 
providing name and usage of the executed command as well as a 
proper usage of the voice command. The system 20 helps the 
user to find the command that the user intends to use by 
5 selecting an executable command from the list. 

A voice message is outputted via the speaker 4 for 
providing the name and the usage of the executed command to 
the user (S406). A voice message providing the proper usage of 
the voice command is outputted via the speaker 4 (S407). In 
10 other words, the user is always notified of the reason why the 

voice command is inexecutable and the proper usage of the 
voice command. 

A process performed when an improper voice command is 
inputted by the user will be explained. A case of setting a 
15 waypoint en route to the set destination is taken as an 

example. A command for setting a waypoint is the "add-point" 
command. The add-point command is stored in the relational 
command list of the set command as a command related to the 
set command. 

20 Assuming that the user has inputted the set command 

during setting a waypoint, the set command cannot be executed 
because a destination has been set. The add-point command that 
relates to the set command is selected from the list as an 
executable command and executed. Then, a voice message is 

25 outputted from the speaker 4 for notifying the user of the 

execution of the add-point command. The voice message says 
something like, "the add-point command is executed, and the 
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currently displayed point is set as a waypoint." Furthermore, 
another voice message is outputted for notifying the user of a 
proper usage of the voice command. The voice message says 
something like, ''You cannot use the set command when a 
destination has been set." 

A function for indicating a distance between the waypoint 
and the destination may be included as an item for the current 
function detection, and the reset command may be added in the 
list. If the waypoint is located between the current position 
and the destination or closer to the current position, the 
add-point command is executed, or otherwise the reset command 
is executed. 

Another example is that an improper command is inputted 
for switching a display to a destination searching mode. A 
proper command for that is an "address" coimnand or a 
"facility". A "destination set" command is for setting the 
currently displayed point as a destination. The address 
command and the facility command are stored in a relational 
command list of the destination set command. 

If the destination set command is inputted while a menu 
is displayed, the command cannot be executed when a position 
to be set as a destination is not displayed. Therefore, the 
address command or the facility command is selected from the 
list and the display is switched to the destination searching 
mode upon the execution of the command. Then, a voice message 
is outputted via the speaker 4 for notifying the user of 
switching the display to the searching mode. The voice message 



is something like, "The display is switching to the searching 
mode," or "the facility command is executed and the display is 
switching to the searching mode." Moreover, another voice 
message is outputted to notify the user of a proper usage of 
the voice command. The voice message is something like, "You 
cannot use the destination set command while the menu is 
displayed." 

[Third Embodiment] 

A voice control device 3 0 includes a frequency data 
storage IH in addition to the circuits included in the device 
20 of the second embodiment shown in FIG. 3. Furthermore, a 
different type of substitution determination circuit II from 
the substitution determination circuit IG is included. 

The frequency data storage IH stores a frequency in the 
use of each command included in the voice recognizable 
dictionary. The frequency is expressed by the total number of 
times that the command has been used by the user. The number 
is incremented by one every time when the command is 
recognized by the voice recognition circuit IB. 

The determination circuit II determines whether the 
coiranand selected by the recognition circuit IB is executable 
in the function settings detected by the detection circuit IC. 
If the command is executable, a signal is sent to the control 
circuit ID for sending a signal to the navigation system 2 to 
execute the command. If the command is inexecutable, an 
executable command is selected from the relational command 
list. If more than one executable commands exist in the list. 
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the frequency stored in the frequency data storage IH is 
referred. The command that has the highest frequency is 
selected and executed as a substitute. A voice message is 
outputted from the speaker 4 for notifying the user of name 
and proper usage of the executed command. 

The voice control system 3 0 changes the function settings 
of the system 2 according to a voice command inputted by the 
user as shown in FIG. 6. The voice coiranand is inputted to the 
system 20 via the microphone 3 (S601). The voice coiranand is 
matched with the commands in the dictionary, and the most 
closely matched command is selected as a voice command of the 
user (S602). 

It is determined whether the selected command is 
executable in the current function settings of the navigation 
system 2. If the command is executable, the process proceeds 
to step S604. If the command is inexecutable the process 
proceeds to step 8605. At step S604, a signal is sent to the 
navigation system 2 for executing the command. The function of 
the navigation system 2 requested by the user is performed and 
the process is completed. At step S605, executable commands 
are searched in the list. If more than one executable commands 
exist in the list, the process proceeds to step S606. If only 
one executable command exists in the list, the process 
proceeds to step 8607. If no executable command exists in the 
list, the process is terminated. 

At step 8606, the frequency in the use of each executable 
command is examined, and the most frequently used command is 



executed as a substitute. Commands often used by. the user can 
be determined based on the frequency stored in the frequency 
data storage IH. If more than one executable commands exist in 
the list, the most frequently used command is selected. By 
5 substituting the inexecutable voice command to the most 

frequently used command, the command that the user intends to 
use is more likely to be executed. 

At step S607, the substituted command is executed. At 
step S608, a voice message is outputted from the speaker 4 for 

10 notifying the user of name and proper usage of the command 

executed at step S606 or S607. At step 609, another voice 
message is outputted from the speaker 4 for providing a proper 
usage of the command selected at step S602. 

A process performed when an improper voice command is 

15 inputted by the user will be explained. A case of canceling a 

set destination and setting a new destination is taken as an 
example. A command for setting a destination is either the 
"set" command or the ''reset" command. The set command is for 
setting a destination for the first time while the reset 

20 command is used for canceling a set destination and setting a 

new destination. 

The reset command and the add-point command are stored in 
the relational command list of the set command. The add-point 
command is for setting a waypoint, and therefore, it does not 

25 relate to setting a destination. However, the add-point 

command can be used as an alternative to the reset command 
depending on the function settings of the navigation system 2. 
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Thus, the add-point command is listed in the relational 
command list of the set command. The frequencies of the reset 
command and the add-point command are X and respectively , 
where X>y. 

5 Assuming that the user has inputted the set command 

during resetting a destination, the set command is 
inexecutable because the destination has been set. The reset 
command and the add-point command are selected from the 
relational command list. Since both commands are executable, 

10 the frequencies of the commands are examined. The frequency of 

the reset command (X) is higher than that of the add-point 
command (Y) . Therefore, the reset command having the higher 
frequency is executed. The rest of the process is performed in 
the same manner as the second embodiment- Thus, it will not be 

15 explained here. By executing a frequently used command, the 

usability of the system 2 increases even for the user who 
usually does not set a waypoint. 
[Fourth Embodiment] 

A voice control system 40 shown in FIG. 7 includes a IJ 
20 instead of the substitution determination circuit IG included 

in the voice control system 10 shown in FIG. 3. The IJ 
determines whether a command recognized by the circuit IB as a 
voice command is executable in the current function settings 
determined by the detection circuit IC. If the command is 
25 executable, a signal is sent to the circuit ID for sending a 

signal to the system 2 to execute the command. If the command 
is inexecutable, an executable command is selected from a 
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relational coiranand list of the voice command inputted by the 
user. Then/ the user is asked to confirm for execution of the 
command. If a voice command "YES" or "execute" is inputted by 
the user, the command is executed. 
5 The voice control system 1 changes the function settings 

of the navigation system 2 according to a voice command of the 
user as shown in FIG. 8. A voice command is inputted to the 
voice control system 30 by the user via the microphone 3 
(S801). The voice command is matched with the coimnands in the 

10 dictionary r and the most closely matched command is selected 

as a voice command of the user (S802). 

It is determined whether the selected command is 
executable in the current function settings of the navigation 
system 2 (S803). If the command is executable, the process 

15 proceeds to the step S804. If the command is inexecutable, the 

process proceeds to step S805. At step S804, a signal is sent 
to the navigation system 2 for executing the command. The 
function of the navigation system 2 requested by the user is 
performed and the process is completed. 

20 At step S805, an executable command is selected from a 

relational command list of the voice command, it is determined 
whether the user has an intention to execute the selected 
command. If the command is executed without confirming user's 
intention, the user may get confused because the command is 

25 different from the one that the user intends to use. If the 

intention of the user is confirmed, the process proceeds to 
step S806. If the user refuses to execute the command, the 
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process proceeds to the step S808. 

At step S806, the command that the user has permitted to 
execute is substituted with the voice command and executed. At 
step S807, name and usage of the executed command are 
announced to the user via the speaker 4. At step S808, a 
message is outputted from the speaker 4 for providing proper 
usage of the voice command. 

A process performed when an improper voice command is 
inputted by the user will be explained. A case of setting a 
waypoint en route to the set destination is taken as an 
example. A command for setting a waypoint is the add-point 
command. The add-point command is stores in the relational 
command list of the set command as a command related to the 
set command. 

Assuming that the user has inputted the set command 
during setting a waypoint, the set command that the user 
intends to use is not executed because the destination has 
been set. The add-point command that relates to the set 
command is selected from the list as an executable command, 
and it is determined whether the user has an intention to 
execute the command. A message is outputted from the speaker 4 
for obtaining the intention of the user. The message is 
something like, "Do you want to execute the add-point 
command?" If the user says "yes" or "execute" towards the 
microphone 3, that is, the user inputs a voice command to 
admit it, the command is executed. The rest of process is 
performed in the same manner as the second embodiment. Thus, 



it will not be explained here. 
[Fifth Embodiment] 

A voice control system 50 shown in FIG. 9 includes a 
substitution confirmation circuit IK instead of substitution 
5 confirmation circuit IJ^ and a confirmation-required command 

list storage IL. The confirmation circuit IK determines 
whether the command selected by the recognition circuit IB is 
executable in the current function settings. If the conmiand is 
executable, a signal is sent to the function control circuit 

10 ID for sending a signal to the navigation system 2 to execute 

the command. If the command is inexecutable, an executable 
command related to the voice command is selected from a 
relational command list of the voice command. 

Furthermore, the confirmation circuit IK refers to the 

15 confirmation-required coimnand list and determines whether the 

selected command requires confirmation of user's intention for 
execution. To make confirmation, a message is outputted from 
the speaker 4. If the user inputs a voice command that 
indicates the intention, for instance, "yes" or "execute," the 

20 command is executed. 

The confirmation-required command list storage IL stores 
commands that requires the confirmation of user's intention 
for execution. The stored commands are selected from the 
commands stored in the command list storage lA. The commands 

25 stored in the storage IL are difficult to correct once it is 

executed. Therefore, the user has to pay an extra attention to 
the execution of the command. 
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The voice control system 50 changes the function settings 
of the navigation system 2 according to a voice command 
inputted by the user as shown in FIG, 10. A voice command is 
inputted to the system 40 via the microphone 3 (SlOOl). The 
5 voice command is matched with the commands in the dictionary, 

and the most closely matched command is selected as a voice 
command of the user (S1002). 

It is determined whether the selected command is 
executable in the current function settings of the navigation 

10 system 2 (S1003). If the command is executable, the process 

proceeds to step S1004. If the command is inexecutable, the 
process proceeds, to step S1005. At step S1004, a signal is 
sent to the navigation system 2 for executing the command. The 
function of the navigation system 2 requested by the user is 

15 performed and the process is completed. 

At step S1005, an executable command is selected from a 
relational command list of the voice command, and it is 
determined whether the coiranand requires confirmation of user's 
intention for execution. The determination is made by 

20 referring to the confirmation-required command list. The 

confirmation of user's intention for execution of the selected 
command is made only if the command is stored in the 
confirmation-required command list. This reduces the number of 
times of the confirmation that is performed when a voice 

25 command of the user is inexecutable. As a result, the 

usability of the voice control system 1, that is, the 
usability of the navigation system 2 improves. 
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If the selected command requires the confirmation of 
user's intention, the process proceeds to step S1006. If the 
selected command does not require the confirmation, the 
process proceeds to step S1007. At step S1006, the 
5 confirmation is made for execution of the command selected 

from the relational command list at step S1005, If user's 
intention is confirmed, the process proceeds to step S1007. If 
user's intention is not confirmed, the process proceeds to 
step S1009. 

10 At step Si 00 7, the command permitted to execute by the 

user is executed. At step S1008, a message is outputted from 
the speaker 4 for notifying the user of name and usage of the 
executed command. At step SI 009, a message is outputted from 
the speaker 4 for providing a proper usage of the voice 

15 command. 

A process performed when an improper voice command is 
inputted by the user will be explained. A case of canceling a 
set destination and setting a new destination is taken as an 
example. A command for setting a destination is either the set 

20 command or the reset command. The set command is used when 

setting a destination for the first time while the reset 
command is used when canceling a set destination and setting a 
new destination. The reset command is stored in the relational 
command list of the set command and in the conf irmation- 

25 required command list. 

Assuming that the user has inputted the set command 
during setting a destination, the set command is inexecutable 
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because the destination has been set. The reset command that 
relates to the set command is selected from the relational 
command list as an executable command. Then, it is determined 
whether the selected command requires confirmation of user's 
intention. Since the reset command requires the confirmation, 
a message is outputted from the speaker 4 for making the 
confirmation. The message is something like, ''The current 
destination will be canceled. Do you want to execute the reset 
command?" If the user says "yes" or "execute" towards the 
microphone 3, that is, the user admits it, the command is 
executed. The rest of process is performed in the same manner 
as the fourth embodiment. Thus, it will not be explained here. 

The present invention should not be limited to the 
embodiment previously discussed and shown in the figures, but 
may be implemented in various ways without departing from the 
spirit of the invention. 



